We nemen je mee in een aantal casussen waarin gebruik wordt gemaakt van data analyse bij de begeleiding van studenten. Aan de hand van voorbeelden wordt geschetst hoe analyse van data tijdens de coronacrisis is ingezet voor studentenwelzijn.
Studenten begeleiden door inzet van data - deel 2 - Alan Berg, Erwin van Vliet (UvA), JaapJan Vroom (Deltion) - OWD21
1. Faculty of Science
Erwin van Vliet – Assistant Professor University of Amsterdam, Program Director bachelor Psychobiology
Personalized feedback to student and teacher using IguideME
2. Faculty of Science
SURF project started May 2021, collaboration UvA, VU, RUG
Comenius Teaching Fellow, started May 2020
IguideME: de digitale applicatie voor activeren, motiveren en feedback geven
https://www.feedbackgo.nl/
3. Faculty of Science
I guide My Education - IguideME
• Students: activate, motivate, personalized feedback
• Teachers: early warning system, optimize course design
• Educational experts: optimize the use of educational tools
Open Source software, easy adjustment to personal needs,
embedded in learning management system
4. Faculty of Science
Learning analytics interventions
Knobbout&Van der Stappen 2020
https://ieeexplore.ieee.org/document/9108528
A study with a combination
of all does not exist!
6. Learning analytics
Constructive Alignment TPACK model
Blended / online
Course
IguideME
Tools
Learning
process
feedback
Learning
environment
Learning
process
Learning
outcome
7. Faculty of Science
I guide My Education - IguideME
• Students: activate, motivate, personalized feedback
• Teachers: early warning system, optimize course design
• Educational experts: optimize the use of educational tools
9. Faculty of Science
Student dashboard: Radar view
Students set a goal grade themselves at the start of the course
A peer comparison is made, based on the student's goal grade
Information is provided about progress
(and push messages are send)
10. Faculty of Science
Summative assessments Formative assessments
Learning outcomes
and predicted grade
Student dashboard: Grid view
16. Faculty of Science
I guide My Education - IguideME
• Students: activate, motivate, personalized feedback
• Teachers: early warning system, optimize course design
• Educational experts: optimize the use of educational tools
18. Faculty of Science
Early warning system
Teacher dashboard
Early Warning System to
quickly identify students
who may drop out
19. Faculty of Science
Grade analysis
Teacher dashboard
Grade analysis that can be
used to see effect of course
design
Configure grade prediction model
21. Faculty of Science
I guide My Education - IguideME
• Students: activate, motivate, personalized feedback
• Teachers: early warning system, optimize course design
• Educational experts: optimize the use of educational tools
22. Faculty of Science
Optimize the use of educational tools
# Difference between Graded and Non-graded assignments (p<0.05)
1
2
3
4
5
6
7
8
9
10
Grade
Graded Perusall Assignment
IguideME (n=29)
1
2
3
4
5
6
7
8
9
10
Grade
Non-graded Perusall assignment
IguideME (n=29)
Grade is not shown to students, only to researchers
Average of all assignments is 2% of the final course grade
#
Recommendation: grade the Perusall assignments
Graded or non-graded Perusall assignments?
23. Faculty of Science
IguideME improves student engagement
* Difference between IguideME and control group (p<0.05)
# Difference between Graded and Non-graded assignments (p<0.05)
*
1
2
3
4
5
6
7
8
9
10
Grade
Graded Perusall Assignment
Control (n=29)
IguideME (n=29)
* *
*
1
2
3
4
5
6
7
8
9
10
Grade
Non-graded Perusall assignment
Control (n=29)
IguideME (n=29)
#
24. Faculty of Science
Results so far
• Students who used IguideME have a higher score for Perusall
assignments and have a higher MSLQ score for critical thinking, self-
regulation and intrinsic motivation
• Positive correlation between the number of times that IguideME was
used and the final course grade
• Students reported that IguideME has helped them with online studying,
increased their motivation, and provided insight into their study progress
• Teachers tracked potential drop-outs early and contacted students, which
was very much appreciated by students
Comenius Teaching Fellow, started May 2020
IguideME: de digitale applicatie voor activeren, motiveren en feedback geven
25. Faculty of Science
Ongoing and future outlook
• Ongoing research: e.g. correlation to study time, summative grades,
correct answers to higher bloom level exam questions, etc
• Enroll IguideME in other courses at UvA
• Implement IguideME at RUG and VU
SURF project started May 2021, collaboration UvA, VU, RUG
https://www.feedbackgo.nl/
26. Faculty of Science
Project team
• Erwin van Vliet (Project leader and UvA team leader)
• Natasa Brouwer (UvA senior teaching consultant)
• Gerrit Oomens (UvA ICT)
• Miguel Pieters (UvA Developer)
• Sylvia Witteveen (TLC, member steering group)
• Bert Bredeweg and Damien Fleur (UvA/HvA, Researchers)
• Alice Doek and Harrie van der Meer (UvA library)
• UvA legal department
• Koos Winnips (RUG team leader)
• Angelo Konstantinidis (RUG educational advisor)
• Sylvia Moes (VU team leader)
• Steering committee: Hans Breeuwer, Sylvia Witteveen (UvA), Hans Beldhuis, Jan
Riezebos (RUG), Hilde van Wijngaarden (VU)
27. Faculty of Science
I guide My Education - IguideME
• Students: activate, motivate, personalized feedback
• Teachers: early warning system, optimize course design
• Educational experts: optimize the use of educational tools
e.a.vanvliet@uva.nl
Open Source software, easy adjustment to personal needs,
embedded in learning management system